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ABSTRACT 

A selective review of rhe liter at ure on 
self- instructional devices is presented, with emphasis on those 
studies which provide for a functional analysis of such devices. 
Three major classes of variables which influence the effectiveness of 
learning by means of self -instructional devices are discussed: the 
characteristics of the device, the characteristics of the program, 
and the characteristics of the learner. Attention is devoted to an 
analysis of the sequencing of material which maximizes the rate of 
learning and degree of retention with a focus on those variables 
which affect this programing process. A working model of the learning 
process is presented which is based on the theories of conditioning. 
The report includes a 37 reference bibliography. (KB) 
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This r».'port ri^prereiits a selective review of the recent literatiore 
deHlir.;; L '';h se 1 f-i r:F,! rue ti on and the a utomi^^ i on oT tenchirif^. This litera- 
r. :rf' hHs ^^ro'.vn i^o rav^idlv aT;ci 5o rn'orusely oV late that workers in the field 
have f'ouna it dirricult to keep abreast of it. It is hoped that the present 
report will provide a ivjrrjnery of emer^^in^-. issues and that it will serve as a 
rolnt c-r reference i'or f;;t\ire research and development in this field. 

T);e author wisnei: 'co ackncw le d j-e his indebtedness to the many people 
who have leaned nim. rA-.eir* unpublished mctnuscripts and who have thus, or in 
rer?cnal aiscuasi on, t inula ted his thinking. They are too numerous to 
mention incii \i. c:ual ly . Dr. J. B. Sidowski and Mr. F. F. Kopstein reviewed 
•the "ift nupori DC e nd made several helpi'ul suggestions. 

Nork on r.hir report was originally bec^^jn because of the author's 
interest in se 1 f -inn t r uc t i on . It was later amplified and submitted to the 
Ti'Hinin.-=- Psycholo; y ? ranch, Aercrpace L?edical Laboratory as part of the 
a:jr, hor's .service as e consultant under Air Force Contract No. 33(616)-6526 
wi r,h the I'n i ve r r i t y o Du yt on . The r ep or t is p ub 1 i she d in supo or t of 
Fro,-5ect 1710, "Human Factors in the Design of Training Equipment," pr . 
Marty Pock-.vay, Pro.-'ect Scient;i?t, Task 77535, ^Automation of Training 
Svsteiiid," Mr* Felix F. Kopstein, Task Scientist 
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ABSTRACT 



Pj, a 5^^^^1^^^^- review ci' t:r;e literMt:'jro on ?e 1 f-ins tr uc ti onn 1 devicen is 
E\ ^^ent^'"^' /'"'^ emphasis on ufiose studies which provide for n i'unctional 
^^UvfIs ^''''^^^^ devices. Three ma.ior clashes of variables which influence 



"^^sticS of the li-arner. 



<>i effe^^"^^^^^^^^ learniris: by ineons of self-instructional devices w.re . 
t^^^^cteT'^^^^'^^ of t^.e device, characteristics of the program, and charac- 



Qjx Vo''^^ ^^tention is devoted to en analysis of the process of pro. '"ramming, 
'^-he ^jT^^'o^^f-nt of the materials to be learned in prorer sec^jence which 



On 



^irnize^ rate cf learning: and de|;;;ree of retention* Discussion is focussed 
^ num^^^ variables of which the effectiveness of the process of pro- 



Si ^^^int^ rr^^r^^^ be a function. Some of these variables have not yet been 
Ut!^>^'^cte<^ ^-'^^ ^^''-•rimental analysis. A workini^ model is presented, based 
r^Yif f^'"iHar processes of conditioning. 



Thi- reoort has been reviewed and is anprcved, 
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I^ITHODrCTION 



Self-instruction holds out the promise to solve, or alleviate imny of 
the problems tliat besot education and training:. The primary purpose of 
this report is to nresent a review of a portion of the fas t-^rowin^^ litera- 
ture on the desi[^n ntid utility of self -instructional devices. Special 
attention will be given to those Ptudies which provide for a functional 
analysis of such devices. 

Other reviewers have concerned themselves with differ- .t aspects oj' 
the literature on automated instruction. Pressey (2^), Skimier (34), and 
Ramo (29) have written brief histories on the subject and have discussed 
some of its economic, social, and even political imolications . J^kinner 
(33) and Gilbert (11, 12) have present rationales for self-instructional 
devices, based upon generally accepted principlos of learnin.;. Finally, 
Porter (24) hfjs reviewed the evaluation studies whicli compared the 
effectiveness of automated instruction with instruction by the more con- 
ventional procedures. Porter also oresented an excellent system of 
classification of the many types of devices which have been sut^gested as 
useful adiiincts to the teachin^^ process . The present paper will r.ot be 
directly concerned with a review of these aspects of the literature. 

Briefly, a se If -ins tructi onal device mit,ht be thought of as an auto- 
matic tutor that presents the learner with a series of problems each 
requirin{5 some appropriate action on his part. In his review of the 
literature on the many types of devices employed. Porter (24, pp 130-131) 
has listed three essential features which distinguish the self-instructional 
device or teaching machine from -che teaching aid. First, the self- 
instructional device provides a sequence of problems which are designed 
to take the learner from a low to a high level of proficiency in a given 
subject. Frequently, the problems also contain information which helps 
the learner respond correctly* The sequence of problems is graduated 
carefully so that the probability of responding correctly to a given 
problem is quite high, provided that previous problems have been correctly 
answered. The sequence of problems employed in a particular learning 
situation is sometimes called the program . 

The second essential feature of a self-instructional device is that 
its use requires some action by the learner at every stage of the program. 
With some devices the learner must answer each problem correctly before 
being presented with another, while other devices permit occasional errors. 
The latter usually provide for recycling the program. The third require- 
ment of a teaching machine is that the device provide immediate confirmation 
or knowledge of results about the correctness of the learner's responses. 
Porter believes that devices having all three of these features might 
properly be called teaching devices, since no human teacher is mediate 
between the learner and the device. He sugfjests that other devices, such 
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fvr. 



1 K. 



A CO) i = 



1' o VM 1 '.;a V, i on r L u:ii< 



t^.o vi ew lrjx\. ' 

in or d o r to ,i\ is t i t ' ;/ - ^ 

instruction, the 

e X r> e r ' i me n ■ ; u 1 n ri n 1 : : 

c r s e .1 1'- i n t r i.:c: t. i o r. ' 



rch on f-'f^ i T-i nr tr uc ti onn 1 :icvicoG 
, in whicli the f I'oc ti venes ? of 
b» en. corrn-^art. : vn th ueachin^' by some more conv^'ntional 
":]\o prt'Rcnt writer shart:^: with Gilbert (11, d 29) 

^.ui anionn ^ c I' va 1 na i;i on rese^ r-c h is nt' ce ssury 
i rnit^'d interest in tlie ba? i c concent of automated 
. rlion of research effort i?honld be devoted to an 
~ pararn^'' tcrs which inriu(?tice the effectiveness 



A d i p t i r:i c t . o ri :r. u y • 
he e i' f f • c: t. i v« > n c s r r i' , ' ■ 
ch'ir^^c torir cicj^ o: t,:'.'; • 
o I' ihe r-e c la s ^' t s o f vn r i 'i : 
pe r t; inert, r e s e n r c » 'i n i i n . 



. anon." three c la s res of vari a b lo? of whi ch 
^'ns traction nr.ay be a function. They are 
p the DrOf^Tani , and of the learner. Each 
i \] be discu^ssed in some detail, and the 
: be ? Mmmar i zed . 



T'iK DEVICE 



For pior poses cf dij: cus ? ici. , a 
of as having four major comron^'nts; 
program; (2) a re^pcnre oantl, wr:ich 
rerponso ; (3) t confirming mec:iar;i F:r. , 
mat ion as to the jorrectnesr of his v-. 
mechanism, which provides the impetu? 
This four- fold Sinalys\s establishes a 
olace a discussion of research on char 
dev ices • 



. ::r tr uctional device may be thou^ 
a :ii :play, which presents the 



ht 



■ ^'i learner uses in forming his 
v:.i.';h provides the learner with infer- 

and (4) a reinforcement 
i'cr f'.:r'",her operation of the device.* 
cor'.v*;ii i, ent framework in which to 
^icter 1. s -.ici: of self-instructional 



Display or Input Characteristics 



Porter (^^3) has reviewed the literature on the devices which qualify 
as self-instructional devices, according to his criteria. No attemot will 
be made to describe the devices in the present paper. Suffice it to say 



♦ The confirming and reinforcing mechanisms are assumed to be combined in 
some types of se If -instructional devices. 
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Lf.au Aoi'KoriL; n»LVO \iv.v \ nice rwui i ■ >i '. , o '.r i j , KtiM .m^^oIcmI coimHuifii t.?; t.o 
n\'i:»'ri'v> iiiM ttfr i a li-. to Lhe h*Mr>;t'r. '^in' v»'ry :>iinp.iti «.i(";i^:n jw.mmiij^ .smI'- 
t'iciMrit:ly uni (;um to warrMnt ;.-^'M';nl Or^rwdtT ^»n<i Hcnmn*' Mnd 

i.jt' rnviicu'lly nu;).i.irirJ t.ox t.lu r >• • 

rortt.:tr' M'^iS <it M uin 'vii r.ru.M.i hctwf.'tin t.wo i (tipor i.Mn t. ways of f^r'estrn 1. 1 n(': 
the orot-rain. The Ti^'si:. .vay mi 'hi bfi called " leMriuT-PKCed, in which Uhe 
device "waits*' for the learner to rei:rond Doi'ovo it reacts, '^oth Pr<'.v>:^v.y 
tuid .Skinner have niaeie vipe o:' thif* technlqiu.-, riio second way ol' preMu'nt- 
in.; ihe prOjjrfti!'. mi^-ht be called **machi ne-puoed/^ in that a ^^-.iven pronit?in 
isS presonned i'or a period ol' Lirno and tnen the maehine acts, whetner or 
not; tne It^arner has resuonck-jd to the o rob lorn. The we i l-'-n.owTi m^'inory arum 
is an e-xannle oi' thij- latter way of' presenting;; the profvram, 

.lilbert (1^:, pv 3-6) hns discussed some of the rr-actical pronleiiu; con- 
nected with i.he Dr-erentation of materials, but i.o tiie writtr's Know lertc-.e, 
no investigator h^is cornrared the e fff^-: tivenojis o\' two or more mecnods oV 
presenting the nror'ra:r. to the learner. One re reared protlem which ini|^,ht 
well receive immediate' attention is the relative e f t'i c i en«;.y oi' fyoup-paoed 
(e,;^.,, n:otion nict'ireL. ) versur Ifarner-naced devices, Limisdaine {'20) hus 
Dointed to some of the slndlarities and differences between the two tyoef. 
o f pre sent a ti on . 

A threat deal of research is necessary tje. fore we know much about the 
ortimum rnnans of ore sen tin, materials t'or automated instruction. It is 
likely th^3 1 the most effective means of nresentin^;; the pro^^^ramwill vary 
as a I'unction of such other variables as the response characteristics of 
the device, the type and amount of subject matter to oe learned, and 
perhans wi tli the characteristics of the learner. 

Response or Outnut Characteristics 

Two basically different moaes of operating", teaching machines have 
been employed. Following the lead of Pressey (27), many have used the 
recognition or multiple-choice method of responding. Others have employed 
Skinner's recommended construction or fill-in method of responding. Gilbert 
(12, pp 7-10) has discussed some of the practical problems connected with 
the two methods of responding, but no study has been found which compares 
them experimentally. 

However, Evans, Glaser, and Honmie (8) did compare the effectiveness 
of the construction method of responding with no overt response at all. 
In this experiment, two groups of subjects learned a program entitled 
^^Fundamentals of ^!u?ic.^ One group made one or more written responses to 
each orcblem, while the other group made no overt resoonses. Interest- 
ingly enough, the group which made no overt responses spent less time in 
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b^Mj't. i u . .'uul »)urn» rM»t>iMitlnn t>er.t McuM'tm tihfui did tiho (r.roup which 

rtJj.-piMiJM,l ovortJ.V to ^''^t^-l^ pj^oblfMH. However, the di l'tV»r(;ncn» wero not 
;M.nti;M.! ffvHy ci ^ ^-"^^^ , xhi fl vnriablt^ iM woi't->hy oV u\orv cart^f'ul 
n t. trrir. i oil , {iitiiM.^ i ^' ^ ^* ^^^\Mr,ihl»' t'li" t. Kt ItfMiiL sotm^ r ** tuunifHjr^ nf.M'cj bo mado 
only n v'M'lly, 

Gilbf^rt •^^^"1^) hon dfM'inod Iho con f'i rrnin^r; mechanism of a 

toachin.j -)oviot> art "^^mj-.s by whicli the learner receives inrormation 

as to the covri^ctm''^' ^ ronpoi^.r.e to a I'ivon problem. The desi^rierfl 

of r.elf-insbrucUoTi" ^ ''^^Nccs frequently assurno that confirmation also 
provides r f:i n To r^'Or'-''^' • ^v^^^.y^ turn producej^ more resoonses. However, 
the pr(?.sent \vr\ tvr nr.^''.^'\c> . Gilbert that conl'irmint^ and reinforcing 
mechanir>ms nU|_;ht he^*^' '^'^ iircusred separately, since they refer to 
separato clar,-es ol' ^ "^'^^'^H-t: rient variables of whioh the effectiveness of 
automated i ns t^Mic^ 1 1^'^^ ^'ki a function. 

The confiv-niin,-^ ^^'^^'^^•u enployed in self-instructional devices can 
be varied in at lo&f^^_ J'^o i„,portant dimensions. First, they may vary in 
the t^-pe or anioiir^t ^'ormn t ) on provided to the learner; and second, they 

may vary in th^ tertip^^^'^ cieUiv petween the response of the learner and the 
delivery of the ^^on'"'^ / '['\\i^\<e r^jb-classes of variables will be 

discuGf^ed sepa^ate].y• 

Iricn and ^ri^b^ (^S) y^Q^ye d'.srribed four types of confirming mechanisms 
approoriate to the P^^ss^^ ^^^^^ ^£ self-instructional device. The first 
is the quiz mo^Xe, ^^ic}^ ^'j^^ ^^earnor , by pressing a srecial button, inter- 
rogates the marine ^^^ich of the lO options is the correct one. 
Immediately a Ii-\hi: ^^nie.^ indicate the correct option. The second 
confirmini; mecHanisJ^ c^j^^g^^ modi t'i ed - quj z mode , in which the learner 
presses the button ^^O^^^e^^ option whi oh he believes is correct. 
If the correct optio'^^i^ chosen, a gre^n li cht adjacent to that option 
cor.es on. ^f the o^^^^o^^ ig incorrect, both a red "wrong^ light and the 
green light ne:ct to ^o^rect option come on. In order to proceed to 
the next probleni th^ ~^^^^^ner must; firrt nress the button next to the correct 
option. The third ^^^^'^^i^i^g mechanism is called the practice mode , in 
which the learner ^^^^ij^^d to keep choosing ootions until the correct 
one is chosen. The ^^^t Confirming mechanism is the single - try mode , in 
which the learner c^^ ^^^tiond only once to each problem! A green light 
comes on if the choi^^ correct; if the choice is incorrect, the red 
light comes on. Th^'^ ^^^^ j^^^t problem is presented. 

Irion and Brig^^ °°^Jiared the effectiveness of the four types of 
confirmin[: mechanisHi^ ^^^^ of three tyPes of learning tasks: serial 
learning, pai red-ass^*^^^ t^ learning, and problem solving. Independent 
groups of 20 subject^ ^^oy^ ^^^^^ given 20 minuces of practice under one of 
12 experimental conc^i "^^^n^ ^ r^^ie dependent variable in the experiment 
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j\t't.ttr ppmU-i 0^' fuui v.wv> w<>rk}! iMlrr. In j^niinrfi 1 , \,\\v Vi'\nl\v*^ i.^ \'V\ cA y\\r.\' 
of tiht^ f^Mir Ivr^f^:' ^^I' (nuilMrmiiii iiif ohMt^. I mum vnw. in !.h<' I'ol low 1 iit; ('lulrM- ; 
qui/, nio.in, movil t'i*;^l-*inl/. iv.o^ir^, t^rMl(^i,icM tinwlr, m^kI - i h, Ir.-t.ry inoJ*- . The 
a:nonn^. (ii ft'orrniN- ifi r. r ri 1 cm^vv VMi'iod nw n Timet. I (Ni o:' t.hf ^..vih' of 

"n!\->flnn"t." ly, ^^l^t' t.M^rT. of o<M; !'i rr' /i 1: i on sLmllrii l^v 1 r i o!i 'n-ii:r,M 
vVMj-o iJiioh thftt number of tiHSii: i n<lopf*nvl(M;(: vai'inblos nri^h^Mv v/ort> 
lnclu(^^^^l^ t^xninp.ln, ms Irion 'trui '^ri;';/.^'. point , U irmy bo t.bnt. 

t^i^' ^'Jiz jnod(' of confirmation orovod to be I'.fMirrnlly t!u^ most ^) f f«;(- 1 i vo ; 
(U ^^CJMVUU") it pern;! ttf.)f.) inoi-n -rnctico trinl;; p(>r nt) i t- tiiiio , booau.MO 
it r».ulviQ^w-[ the numbt»r of orrors whit'b could bo comiuittod, ( ) btjc^uifio It 
oUniii\f\^g.a ttver:-ive ;^ ti rnuln t i on ru^jultin/ Vrom thr t;rror' bu/.v.t^r, or 

(4) bocauf5o of 5U)me oombiriHtiori of tn,f».so varifibler, . Alt.hmi^h Irion uu<.\ 
?ri^y,ti answered Fin important prJK^ticnl quistion, U wo\.ild sourn that, 
ultimfitely, thu problem of optimi n;j the oonf i rrnlnf;; m»'chftnit'rn of tv scll'- 
Instruoti onal dovloe nmst bo attackb'd in such a faiiliicn that tho offoctr. 
of eacl^ variaolo can properly internre.'tod . 

IHvestii^ator« who prefer to have the learner construct his onnwora 
to problems rather than simply reco^^nize them, have al:^o tMnoloyed at 
least types ol' con firmin-;; mechanisms. Skinner (33) has used a device 

which t)res(jnts the learner with the correct answer to a problem as soon 
as the learner comnletes his response, whether or not the response is 
correct^^ r^y recycling the prof^ram, the learner eventually answers all 
problems correctly. Recently, Skinner (:55) expressed dissatisfaction 
with this device because the second attempt to answer a (^iven problem 
may be partly under the control of the previously revealed response. 
Skinnex* ^as also developed a device which continues to present a c^^^®^ 
problem until the learner responds correctly. These two types of confirm- 
ing iTiechanisms parallel Irion and !lri2,^;,s' quiz mode and practice mode, 
respe.Gt.ively . 

^4lbert (12, pp 10-15) has discussed some of the practical problems 
connectied with the use of the quiz mode and practice mode of responding, 
end he ^as suggested a third method of responding. It incorporates 
features of both the construction and the recognition methods of respond- 
ing, ^en faced with a given problem, the learner first constructs his 
answer, then he views a number of alternatives and chooses the one which 
most Closely resembles his response. The machine then informs the learner 
as to the correotness of his choice. Gilbert has also suggested that the 
confirming mechanism might present additional information at the same 
time i-t; confirms the learner's response. The promise of this latter 
suggestion is supported in the findings of Evans, Glaser and Homme (8), 
who showed that the learner need not respond overtly to all of the 
materials in a program. To date, none of these suggestions has been 
subjected to experimental comparisons using the construction method of 
responding. 
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.1, :!',,, r* •,-^••1 V;.. ! i ! ' ■ r • ' . i ' » ^'i^ :.Mv-h ( • V n i ' im 1. 1 v '1 1 rt.'lJW-M 



: • . •■ ! ■ : ^.v. ,\\ r-- ; ]."riih I i ;M. ot'si^ ['Hirt'vj^ 

* i . ; ' ■ , ; \ I • ■ " f : . i : . • Li • • 



i • ,,tM i^' : , <' r-M- ! M 1 1 , ; ! :if o r i n t^vre:- of 
'.v :■•.■!; <;o:;:' i ;^'rt; : r- i ns t^rvicM onn ] d(^vicc!S 

. : .Jf;vi c;r'S y r'cr.dor t.h(?ni cn-.^^iblo of 

• of f'r:' ^ i i 1 1 n 1 1-^^ o ^ 1 v . K'ic}i l'''"rror mi--,ht 
:, ! "f : ror-,;.'- vvr;:'.:}; could bo corinC?c:t;rd with « 

'['■•'-••r Aci';';; rrcr^ r\t tn*c.T*'ni >uu3 r^-Hct to tho 

♦ -'i •«• .Vv-'';i.i 'it vwr : uron rnnxi.rnnrr. nt'^if'"! •'^Hib.lo 
i *' . • ' ■-.•V'v-v • !*'■'.:( }:^ i c o»i t'i rrvM 1 . 

i i .^'vL':<. :■: ;,::m\. i-'trriri,; ir ::\oi w vnrir: wrtMi imniedi ^« t^' 

■'Ir-rr.' './icu :'cj 1 1 rv;:-, :* ^^-r."r'^- nti.v:^:::o^ to ati.swer a riven pro:;lem. 

I . n.' evL'erre ■e^^^: t t a ttohr.icue c^ll^'Ci resnonse- 

r^^'-^"^ '.v^:, r::c;*':^ o fl'^-'O i ^, ve '^S These investigators 

" r-'j' J \ .-^ f c r/" vori'; :-• of c rrocc ::'.;'^es in n paired-associate lenrn- 

" ^ c'.-n I'.i r c^: t':rhr:ia-je involved the presentation of 

tr.c; r-.. rr c\r'- It-*-?.', ^^"or t::'v- ■•; r^r:'- h-^d Ett t^rjrr.pte^d a response • The nroiTiDt- 
•■.;r:* techr; i c ' irvoi-":-': or s rj-. tn ti or of the rerronse term before the 

1 • • ♦ : r r. •-• r rn '.i . : »i h i r e h- : - o r . ; ri r r. > ,j 1 1 s c ; ' ^ : : e e x r r i rne n t s h owe d t ha t the 
r^-r.:- c.:.:(^''\>rrrTs:zinr Le:-r.!:i c:-jr' vie 1 'jed !'art:-r 1 o'-irnin,^ thn t thf' c^';nf^ rmation 
tv- :h.vi . s:!T;i]nr res'.ltr xere OL:tMin*^d ::)y Kont^tein and Roshel (19), who 
M I ••■ r. r », r - r ^.^^ i t h ':, \ ; , -r. Q.f r e r r c n r ottvp tin." o ve r con f i rmat i on 
r^h'-' i hi- r^^»v of' le'':r- [r.-/ incre.'.i r'^fi . i'urti-.f^r r^^^se^iroh of the 
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Con.' i I'M'M i ^-^i. shpiiM u*- , i vf> ^'t' *' MM'i.t^..- ()•:••:; t ; o;!;- hhvin/ t,o. 

tVi^m fri^.oniM t,r<i inj-> t.rMi(M,i ^ ti i Mm- I'r*'-''*''' rt i n : orc^nit'ii t. -vrii'h f.l r' ]cHT'n»'r 

t.c-l''Mrn. e'xp.' ri !i;t n -vtiic:! b-Mr illr>'f;ll\ on uhW". or'c^hl'Mn h>ivi' n'M»n 

\;n(:ovorti. O''^ Vlc:}iMe-l find Vncr^oby (J'^-) * or ('orint'ii n rrN'vnnt, o x^cm* iiiimt. or\ 

*'0*'ru(. o'' t,ru.i n i ri'", Ti Iihm on V.csl. ror t'or'innrnM:' . Thrj-p workorr c'lono 1 udwl 
l\\t\t l\v bonotMt from aurliono'' t-n r t. i r: i r^i t, 1 on M,.^>'n^' t;o j^t.nm orimHrilv t'T'oin 

r:'f'fu;t;s or* i^rnc^^ioo, nr. 1 r\o*. from fu; i no rvn r o in inol. i vn t.' on . Vovc 
Vf^rn^iyr/r, ^ofrnri roouir*'! on ^..h\ t\ i rnnor' ^'i^it mp'sMtMi within tilu: conLoxt, ol' 
fi':tomMtrfi instruction . 



A ?o ootid a\je:::, ion rr'Wjt.t il to rfMriforoLn,- churn c t or i ^ i c ol' ;>' lf- 
inr t,ruc tl ona 1 vU?vicos stfMTis from n wnrnin;'; mndc by both Porl^'r {?A , p 1(^5) 
and Keislnr (17) of n novo Ity effVct in connertion with tho uro of oon- 
firmntion n.s the r;ole ro inl'orcetnen t . It mny well bo tf.nt con f i rn.'A ti on 
would lose its roint*orc:Ln[^ pronorty ovoi- a period of tirno. Por.tor (1^5) 
reports thn t th»j n d vf\n t?.< of awtomnted inf^truction over stnndnrd inothod 
of toacfiin,; sb.owed no diminution over a oeriod ol' five months;, flowover, 
more research is noces?nry beforo we can bo liui'o thnt confirmation can be 
relied on to mainttiin its reinforcin^; ororcrty for lon;';(!r oeriod? of time. 

A third cjuee-tion has to do with the ontlmal schedule of reinforcement 
to be employed. Host ret; marchers ar.roe tha^^ the prc^-rram should bf3 care- 
fully calibrated so that the probability of the learner's answering; questions 
correctly should be very hi[;;h, resultin;^, in a schedule aporoachin^ 100 per 
cent reinforcement. Skinner (33, p ^5) stated that the completion of a 
given number of problems on his machine alr,o constitutes reinforcement. 
r!e thinks that learners are operatinf^ under a special type of partial 
reinforcement schedule which has been called "reinforcement on a fixed- 
ratio with counter.*^ Further, both Pressey (27) and Skinner (32) think 
extrinsic reinforcement mi^-^ht also be emcloyed. No research has been 
uncovered which tells us about the optimal kinds and schedule of reinforce- 
ment to use . 

Finally, one should be careful to distinf,uish betrween two kinds of 
events which mi[;ht be reinforced. The firrt is responding; ner se, and the 
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ocr.; is i*ei::^ondiiij corrtctiy. Fresum&bly, the second k-ind of event is 
tr.'.: prcrer one to reiiuorce. Skinner (33, o 45) reoorts thut leerners 
r.av- u i;^ rici^Ticy to ros'-^cnd carelessly during the first cycle of the pro- 

r'i!:, '.r 1.15: tin 'co "^'^ look ^-z the correct i^nswer to clear uo the assignment. 
::e -jtrio'/ut.s t;;is i:o:;je::cy to ':oo hi^h a level of motivation, stemming 
from de^i^n of hiss niacrine, oresuiraiDl y the reinforcing mechanism. 

Ski:.:i*.r (33, nr- 32:-3c) h^.s su::gei^ted that the freq^-^ejicy of deliberate 
hTrori' v/ill bt.- red'jced by imoosing a 5-seccr.d delay in presenting the next 
r r I. b ! t , v; r. rx vcv s c h errors oc c iir . 

It eet.r.r c^;ar Trcrn zr.is brief discussion th^^it the nature of the rein- 
:'oi*ce:r.ent: e.-rpicyed i:; self-instructional devices has not yet been carefully 
i'. r. • 1 1:-' .i , :v. i ; ' * b. less ? d v q ' : ^< t e 1 ; s t ud i e d • 

Fro^^r:ir:.::ir-g refers' to the arrv.ngement of nieterials tc be learned in 
zr,^' or.irjT c:' rrcserita-cicu ;vhich vrlll tend to riiaximize the rate of acqui- 
sir:ic:- void retention. It is nopsible that sene simple tasks require 
li:tle ill the my cf Drcr^iimnin,^, out it is very likely that the develop- 
merLt of efficient orc^rarns to oe used in the teaching of comolex skills 
rr.u5T. v.>-^it on a thorou,-:h functional an'^^ lysis of the characteristics of a 
nrOi'r-vn which influences both, rate of acquisition and retention. 

Aute:r:ptc ht.ve oeen m^^de to program many different kinds of subject 
::'.::tr;r, runtting fror^ the te-^iching of contract bridge (7) to the dei;'elop- 
r:rnt c r.;aniJ^:£ri a 1 s>ills (23). However, the present paper is not con- 
C'vrned //ith che pro - r^^n;rr ing of any particular kind of subject matter, but 
ruther v;i tr: the ch^^r l:v-ri s t ics which are orobably comrnon to many kinds 
of ::.ar.eri<^; 1^ . 

3;<ir::.^jr (32, 33) \7^s the first investigator to give serious attention 
to the :.To:3lern of rrogra::-T;ing for automated instruction, t-'ore recently, 
iilbert ('11, 12) han described in considerable detail some of the principles 
of rrcc-rn- ^-rosition. In addition, Crowder (5, 6, 7), Meyer (21), Beck 
(1), an:J "llaser, Horr.me and Evans (13) have made imnortant contributions to 
our under rt'3n'Jing of the process. The description which follows is an 
attf.'-irt to s\Tithesi2e rome of the views of these investigators. The 
a.-alvsis is directly concerned with the development of verbal and symbolic 
likllli^, out it ;r.i::ht also apply to the development of psychomotor skills- 

S:ever (21) ria? descrioed three m.ajor steps in composing a program for 
the f^. .;toi::r.T:ic teaching of a given subject. A description of these steps 
rrsrj co couched in tcrrr^s meaningful either to the curriculum specialist or 
uo th- D^-ycholo/i St . In the interest of clarity, the writer intends to 
u e 0 0 *. h ^;r o up s of t r :h s . 
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ProgramiTiing as the Curriculum Specialist Views It 

From the point of view of the curriculum specialist, the first step 
in program composing is to delineate the entire field or subject matter 
fo be taught. Terms, methods, fac-us, principles, theories, etc- must be 
collected. (One might think of these as answers to quef-tions which might 
appear on a final examination for a given course.) The second step is to 
ascertain the learner ^s level of understanding of the su' iect matter before 
any training has begun. The third step is to arrange the subject matter 
into a logical order which is conducive to rapid learning f:nd good retention. 

The arrangement of the sub.iect matter into a logical order can be 
further analyzed into three distinct steps. First, a hierarchy of the 
materials must be established, so that the learner will first master ele- 
mentary skills which he will later use to develop more complex ones. 
Second, the materials must be arranged in steps small enough to be t>^ken 
readily by the learner without being so small as to impede learning. 
Finally, the urogram must pro^/ide for sufficient learning at each step in 
order to be sure that each steu will be adequately learned. Otherv^ise, 
forgetting might well take place before the skill is put to use later in 
the program. 

Prograrrjning as the Psyc hologist Views It 

The Dsychologist who is interested in the study of the process of learn- 
ing might describe in quite different terms the steps involved in composing 
a urogram for use in self-instructional devices- Presumably the psycholo- 
gist's major contribution to the study of automated instruction techniques 
would stem from his understanding of the optimal means of effecting the 
transition from low to high levels of proficiency wi th respect to the 
subject matter to be learned. For this reason, a somewhat detailed analysis 
of the program seems required, in an effort to isolate the variables of 
which the effectiveness of a program might be a function. 

For ease of communication, one might characterize an entire program 
as consisting of three tyoes of stimulus-resDonse connections.* Terminal 
S-R connections refer to the stimulus-response connections which we want 
the student to learn. Initial S-R connections refer to those stimuli 
which, at the outset of training, are already the occasions for those 
responses which, to some degree, approximate the responses the programmer 
wants to teach. Finally, transitional S-R connections stand for the steps 



In this paper, the term stimulus -response connection is used only as a 
matter of convenience. The writer does not imply an absence of covert 
stimuli and/or responses -^^^ich mediate the ,onnection. 
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which can be exoected to medi?:te the initiel and terminal S-R connections. 
A number of transitional 9-R connecuionr. might be required to bridge the 
gap bet'.sver; a oari^icuiar rair of initial and V/rridnal S-R connect:i ons . The 
first -ornnsitional S-R connections would only crMidely approximate the 
termiuH.] connections, both .vi th resnect to stimuli and responses; the 
second tr5'n s I ti cnal conrecticns v.'ouia appr c;^ mate the terminal connections 
more closely.; the third even more; and so on, until the terminal 3-R 
connection^ i^ve reached. ri^ure 1 snows a schematic reu : jsentati on of this 
conceotion oi' .'i orO:rarr,. 



r. 



Initiii I S::in:ulus- 
r e s n o I ? e c o nr. e c t i ons ^ 



Transi zi cnal 

s c i m u 1 u s - r e 5 o : i . : 

connecti ons 



TerrniriH. 1 stiiTi''ius- 
resDOnse coniiec ti one 



i 



S - R^. 



S - Rbi* 

I 



S - }U 
S - Ril 
S - 



3 - R,- 



S - 



; ur e 1 . t r i x sr. cv/i ri ^ f". : . 

initial s t i r. i I l: - r e 
transitional cot.:ir:;ct 
the terminal stimiil;! 



tveloTDmf-nt of a program from 
Donse connections, thj^ou^h the 
ion?, and finally aoproaching 
'e^^Donse connections . 



The DsychoiOr^is" t might continue nis an^^lvcis of orct^ramming by point- 
in;: to t-A'O pr-obiems connected with trie oraerin^ of materials to be used in 
automated instruction. First, the learner must bo caused to emit the 
approDria^e responses, and second, these resron.^^es must: be brought under 
the control of the aooropriate stimuli. Clt-arly, tnese operations cannot 
be nerformed in one great step from the initial to ine terminal S-R con- 
nections. Rather, a series oi' intermediate steps muse be established which 
guide the learner at every coint along the wiiy. At the out?et, the pro; ram 
snould consist primarily of initial S-R connections. The tonography of 
these connection?, must undergo a systematic change to become transitional 
S-R connect:ions , and these must undergo fur oner cnangss, until the terminal 
S-R connections are reached. At least two well-known orocesses of condition 
ing seem to be involved in changing the topograrhy of the S-R connections. 
They are stimulus-di scrinination and response di fferenti a ci on . 
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Various invesLi j^auors have described three sxeDi involved in guiding 
the learner through zhe program from initial S-H connec cion:^ , thi'OM^.h the 
transitional connections, to the cerrninal connections. In order zo simplify 
matters, consider the develoomenc oV only one tei-rranal S-Vi connection. 
Mrst, the stimulus of the initial S-H corinection is paired with tne stimulus 
of the first transitional S-R connection. (The reader will recall tnat the 
former tyoe of stimulus is, by aefinition, already the occasion for the 
resoonse which aporoximaoes the ae.sired one.) Vmen these two kinds of 
stimuli are oaired, the learner's rirst response should be the reoDonse of 
the initial S-H connection. ■■Jilbert (11, p^ 20-216) calls tnis proceri^s 
auj-vmentini^ . 



The second step in the prcce.sj? is t^ e.xt in^Mii sh the ret^ronse cf the 
initial 5'-H connection throurn non-reinforceiaent, * thus oer mi t c m^; the first 
transition^^ 1 response to appear and be strengthenea throui-:h reini'orcentent 
(SJcinner, 34, p 970). The third step in the process is graaually to elimi- 
nate the stimulus I'rom the initial S-H connection, leaving only the stimulus 
from the I'lrst transitional S-R connection. This prcce.ss has been called 
fading or vanishing (34, p 97c and 11, pp 2Z^'26)* The connection id said 
to be established v/hen only the stimulus from the first transitlonai S~H 
connection evokes the response iror:i that connection. 

The tnree steps may then be refjeated by pairing the stimulus I'rom the 
first transi 1 1 oiial S-R connection with the stimulus from tne i^eoond tran- 
sitional S-R connection. Then, by differential reinforcement, the response 
of the first transitional cormection is weakened and the response of the 
second transitional connection is s trenj;thened. fiext, fade or vanish the 
stimulus from the first transitional coiinection, leavin^^ only the second, 
until the second transitional connection is firmly escsbiished. This 
process is repeated over and over, tmtil finally the terminal S-R corjiection 
is established. 

At least two classes of indeuenaent variables are s u|-;r:ested by the 
present analysis. The first variable nas tc do with the amount of stiiruluij- 
augmenting built into the program. In other words, the extent to which 
the correct response is prompted by stimuli which accompany tne problem 
is a variable oi' which the efficiency of a program m.ight be a function. 
The implication is tnat there is an ontim.um degree to which tho stiiaulus 
of the first transitional S-R connection should be augmented by the 
stimulus of the initial S-R connection. Too high a degree of augmenting 
would waste learning tim.e, while too low a degree of augmenting would 
result in frequent errors. 



* In this case, extinction is ass'^.ed to be either stimulus- or response- 
produced, and in either case, it does not neces sari ly r equi re overt 
responses on the part of the learner. 
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The second variable suggested by the oresent analysis is the rate of 
fading of the augmenting stimuli, once the response of the first tran- 
sitional ^-H connection has been evoked. Once again, there should be an 
optimum rate of fading;: or vanishing of these augmenting stimuli. Too 
slow a rate of fading would waste learning time and too rapid a rate would 
result in frequent errors* The frequency of errors committed by the 
learner as he proceeds through the urogram can be manipulated either by 
varying the amount of augmenting or the rate of fading. The effect of 
frequency of errors upon the efficiency of a program is discussed later. 

In addition to the methods already described. Skinner (33, pp 38-40), 
Beck (1), and others have .suggested a number of techniques which might be 
used to evoke correct resuonses from the learner at every point in the 
program. Heck has called these rules of programming and has attem.pted to 
classify them. One technique consists of giving the learner some materials 
to read, either before he sets to work on the program or while he is work- 
ing on it. Another technique involves the use of the context of the 
problem as a means of e lining ting some strong competing response. For 
this purpose, the correct; answer might require a word vrtiich rhymes with a 
word in the problem or v;hich is the ooposite of a word in the problem. 
All sorts of techniques have been suggested • It seems clear that these 
techniques simply provide FtLn;uli which reduce the probability of an 
error response which might otherwise occur. In a sense, the techniques 
provide for something akin to stimulus-produced extinction. 

It is clear that the conception of a program as described in this 
paper does violence to "programs** as they appear in real life. Skinner 
(35) has already noted that it is probably unwise to teach students 
specific responses to specific stimuli. Students should learn to respond 
correctly to questions abc^ norticulrr subject matter, but they should 
also be able to deal effectively with closely related materials not 
presented in the program, and certainly, they should learn to answer 
questions in their own words and not simnly parrot the responses as they 
appeared in the program. In short, the leerner must establish relations 
bet^-veen a class of functionally equivalent stimulus events and a class of 
functionally equivalent responses. There, the writer would agree that it 
is' probably impossible to specify completely the terminal S-R connections 
or the initial or the transitional S-R connections. 

However, such considerations should not lead us to stop building 
models, especially if the model permits us to see more clearly some of the 
variables which influence behavior in a learning situation. The present 
analysis cannot be said to say anything new. Researchers interested in 
programming have already implied all of these processes. It merely 
summarizes their thinking to make the current issues more explicit. 

It should be noted that the matrix shown in Figure 1 is defective on 
at least three counts. First, the matrix fails to show that some tran- 
sitional S-R connections are also terminal S-R connections. Second, it 
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^^ils rnaice clear that two or more transitional connections mi^ht be 
^'^^bin^^ -orm one terminal connection; and third, the natrix fails to 
^hovv t^"-*^'^ ^ biven transitional conntxtion mi^-ht play a role in the for- 
^'^'^ion ^''O-'^e t}\an one terminal connection. A. more comrlex matrix could 
^^Qorp^^®^® all of these features. 

^ror in Progra m '.Vritir.g 

is relatively easy to describe in generalized stimulus -response 
^^^ms ^'^"^^s 0^ ^ r^rogram to be used for the automatic teaching of a 

^Ub-j^c^' quite another matter to specify nrecisely how to go 

^^^ut c^^^^^^-^^-b one. At least five sources of error may enter into the 
^^^ces^ • ^^irst, the programmer may incorrectly specify the sum total of 

-^-gj-minal S-R connections to be formed. This would amount to saying 
t^^^' curriculum specialist failed to delineate comoletely the subject 
^^^ter taught. Second, the Programmer may err in his estimate of 

eT^tent of the initial s-R connections, v;hich amounts to saying that 
^Hq cu^'^'^^'^^^^ soecialist overestimated or underestimated the learrver's 
■^^Vel understanding of subject matter before training has begun. Third, 
^h^ ^j.0;;r8mmer may not provide for sufficient conditioning of one or more 
^^^ns'^^°^^^ or terminal S-R connections. This error v;ould be comparable 
^0 the f^^^^^® on the p&rt of the curriculum specialist to nrovide for 
^Uf£»^^j^ent training on any asnect of the subject matter. Fourth, there 
^*^y be mere defects in the order of the progression of the tran- 

^^ion^^ S-R connections. In the nar lance of the curriculum specialist, 
L^^^h a ^^^^^^ would amount to teaching complex skills before the learner 

j^g^gtered more elementary skills which make up the complex ones. 
^"^^allV^ nrograrrmer may make premature progressions in the topography 

the ^^^^^^"^i onal S-R connections. To the curriculum specialist, this. 
^*^^ns "^^^ Isvel of complexity of* the subject matter is being raised too 
^^^idiy learner cannot keep up. 

considering these five sources of error inherent in the process 
^^^posing a orogram, one should keep in mind the important concept of 
"^^^ivid^^"^ differences. For example, the initial S-R connections and the 
^^^Unt conditioning required at each transitional step may differ 
^Oj^ .^^rably from one learner to another. This problem and ways of deal- 
.^ji it will be examined later in this report. 

pj^y of these five sources of error may seriously impair the effective- 
^^^s of ^ Program to be used for automated instructional purposes, and the 
^^^er n^^®^ °^ sources may lead some to believe that there is little 
^^^nce ^i'ting successful programs. Indeed some of these errors have 
^^^eady reported in the literature. Meyer (21) apparently over- 

^^^imat^*^ extent of the initial S-R connections. In developing a 

^^^^rairi teaching of arithmetic to elementary school children, she 

^^^Umed "^^^^ children could match numbers which were presented as 
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stimuli with number? tc be used as responses. The program also assumed a 
minimal readinr vocabulary (words like 'Ms," '♦here/' "and," etc.). Later 
Meyer founc that these assumcticns were not warran*:ed. 

^:oreover, Keislar (l7), who develooed a program for the teaching of 
certain mathematical conc^ents, also apparently erred either by making pre- 
m.ature transitions of uhe transitional S-R connections toward the terminal 
con::ectior.s or by failing to provide for sufficient condition once the con- 
nections had been established. Keislar reported that subjects made too 
man}' errors in goint- through the relatively short program. Undoubtedly, 
other inves ti;:ators have committed one or more of the five kinds of error 
here described, without reporting it. ^oth Meyer and Keislar attributed 
the faulty performance of the learners to defective programs. Although 
such errors clearly point to the need for further research, teachers who 
employ the more conventional rr:ethods oi instruction might be less inclined 
to be so self -critical. 

In any event, the sources of error which enter into the composing of 
a orc.-rem to be used in a teaching device are precisely the same ones which 
enter "into the use of standard pedagogic m.ethods. Farther, although the 
evidence is far from clear-cut, it appears that when self-instructional 
devices are experimentally pitted against standard methods of instruction, 
the former prove to oe the mere effective (26, p 139; 8). 

A F-3iCT:CMAI Ai-^-ALYSIS OF THE PROCESS Or PKOGRAh'.MING 

Several investigators have described what have been called principles 
of program^ming and v^hile there has been qonsiderable overlapping, each 
worker'^has contributed something new. The present writer has attempted to 
incorporate into one statem.ent the principles ;vhich have been suggested by 
Skinner (32), Gilbert (11, 12), Meyer (21), and r.laser, Homme and Evans 
(13). 

However, it should be noted that these principles of programming, as 
stated by most workers, simply constitute problems which the programmer 
faces ^^en he attempts to com.nose a program. As such, they offer no 
solutions and each programmer must solve these problems as best he can. 
In the interest of scientific efficiency, each of these principles might 
better be thought of as a class of independent variables of which the 
efficiency of a program might be a function. Glaser, Homme and Evans (13) 
appear to think of them this way, and these investigators have already 
begun a functional analysis of one class of variables and have suggested a 
line of attack upon another. Such functional analysis of the process of 
programming provides a convenient framework in which to summarize previous 
research findings and to suggest new approaches which might be taken. A 
de?cription of five classes of independent variables which may influence 
the effectiveness of a program used in self-instructional device fo Hows . 
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1. Relevance 



At the outset, the prograrjurier must specii'y precisely tne termiiifal S-R 
connections to be formed, i.e., what responses are to be brou^nt under 
the control of what stimuli. Skinner (32, p 93) ilrst described this 
princiole, but the term relevance comes from 'liibert (ll, pp 10-17), who 
stated that the problems to be oresented in the rro^ram fhould represent 
the kinds of problems which you want the learner to solve, and the 
responses in the program should approximate tne resDonses you want him 
ultimately to make. 

Glaser, Komme and Evans (13) have rel'erence to relevance variables 
when they sueak of '^behavioral end-products*^ and they emchasize the 
importance of soecifying precisely what form the skills to be learned are 
to take. For example, the optimal properties of both the teaching device 
and the prct^ram are likely to depend on wnether tne learner is to acquire 
facts, solve problems, or make praci:ical apolications of the materials to 
be learned. This is the old Drobieri. of tranpfer from the learning situation 
to the task for which the learning is intended. Porter (24, p 136), 
Kendler (18), and Keislar (l?) have aiscussed some of the problems of 
transfer which might arise Irom the use of se If -instructi onal devices. In 
short, these investigators seem to be saying that a complete functional 
analysis cf the process of Drogramming would include consideration of the 
problem of transfer from the training situation to the actual task situation. 

2. Availability 

The proj^rammer must also specify precisely the initial S-R connections, 
i.e., those connections already in the learner *s repertory which approximate 
the terminal S-R connections and from which the transitional S-H con- 
nections are to be developea. Skinner (32, p 93) and Meyer (21) have 
described this principle but it seems to have been overlooked by others. 

To the writer's knowledge no research has been done on the nroblem of 
specifying the initial S-R connections, on which the program is to be built. 
Presumably, most researchers think of this as a problem for the curriculum 
specialist or the psychological tester. 

3. Sequence 

The programmer must specify the optimum order of presentation of the 
transitional S-R connections which will enable the learner to proceed from 
the initial to the terminal S-R connections in such a way as to maximize 
the learner's performance on some criterial measures of learning and 
retention. Gilbert (11, pp 26-28) described this class of variables, but 
he had reference to the ordering of machine instruction with expository 
teaching and simulated field experience. In the present paper, this class 
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of variables is given a broader definition to include both the views of 
Gilbert and those of Glaser, Homme and Evan^; (13) • 

Although no research has yet been done within the context of automated 
instruction on the oroblem of how best to order a program, two suggestions 
have been mde . Skinner (34, p 974) thinks that, if possible, a single 
program should be developed through which all learners must proceed. This 
might be thought of as a straight-line program. On the other hand, Crowder 
(5, 6, 7) has'^developed a program which permits the branching of the subject- 
matter so that allowances mi^ht be made for characteristics of the individual 
learner. More recently, Gilbert (12, pp 19-23) has presented a rationale 
which gives his reasons for preferring the straight-line to the branching 
tyoe of program, but he ooints out that the issue must ultimately be resolved 
by the aocropriate experiments. 

VVhether one uses the straight-line or the branching program^ the 
problem of sequence still remains. Proper sequence would permit the most 
rapid shaping of the learner's behavior and result in maximal retention. 
The process of shaping has been described in this report in terms of the 
well-known processes of stimulus discrimination and resoonse differenti- 
ation, and the writer has proposed two independent variables of which the 
efficiency of a program might be a function. So far, no research of this 
tj^e has been published. 



4 . Stepping 

After the proper sequence of transitional stimulus-response connections 
has been developed, the programjner must specify the size-of-step from one 
transitional S-R connection to the next. The size-of-step can be defined 
operationally in at least two ways. ^/Then it is used as an independent 
variable in an experiment, it is usually specified as the number of steps 
in a orogrem which takes the learner from the initial to the terminal 
stimulus-reFDOnse connections (15). The greater the number of steps, the 
smaller the median size-of-step. '^Tnen the term is used as a dependent 
variable, it is usually specified by the percent of incorrect responses. 
Thus, if learners make few error responses on a given program, the size- 
of-step is inferred to be small. 

At one time. Skinner (34, p 975) believed that the size-of-step should 
be so small that the learner rarely if ever made error responses, but more 
recently, he has adopted the position that the optimal size-of-step is an 
empirical question, which may be answered by finding the size-of-step that 
maximizes learning and retention (35, p l)« 

In one of the first experiments designed to provide a functional 
analysis of the process of programming, Evans, Glaser and Homme (13) 
investigated the effect of number of steps in a program on learning time, 
on the frequency of errors during learning, and on immediate and delayed 
test performance. Using a single program on e lementary number theory, 
these workers varied the number of steps over four values; 30, 40, 51 and 
67. Since the initial and terminal stimulus-response connections were 
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held constant, oresunably the p;rf;t.ter the number of step^^, the smaller the 
median s i ze-of-s tec . Independent groups o;' five subjects each were used. 
The results show ^hat, within limits, increasing the numcer of steps in 
the program resulted in decreases in the number of errors on immediate and 
delayed performance tests. In addition, smaller steps also resulted in 
less time-Dcr-steo and fewer errors during the course of learning. Evans, 
Glaser and Homme point out that the optimum size-of-step might be exDected 
to vary as a inunction of the tyoe of subject matter being orogrammed. 
Clearly, further research is in order before this imuortant question can 
be answered unequivocally, but a start has been made. 

5. Maintenance 



The programmer must specify the amount of conditioning required of both 
transitional and term.inal stimulus-response connections to guarantee 
adequate learning and maintenance of these connections. Gilbert (11, pp 
17-20) has discussed this problem in some detail, under the orinciple of 
repetition. He states that optimum reoetition requires the use of a 
minimum number of problems and a minimum sample of problems in a given 
class and a minimum amount of time invested Per student which will produce 
a satisfactory probability of correct responses. He suggests that review- 
materials be seeded at various points in the -program to be sure that tran- 
sitional stimulus-response connections 'will be maintained. Although the 
problem of repetition or maintenance lies clearly within the province of 
the psychologist interested in the learning process, no experiments were 
found on this problem as it relates to automated instruction. However^ 
the abundant data on overlearning and under learning (36, pp 728-732) seem 
appropriate. 



CHARACTERISTICS OF THE LEARNER 

A third major variable of which the effectiveness of automated 
instruction might be a function has to do with characteristics of the 
learner. The concept of individual differences has been implicit through- 
out the preceding discussion of the variables which might influence the 
efficiency of a program to be used for the automatic teaching of a given 
subject. For example, the kind and number of initial S-R connections 
available to the programmer for use as starting points for the program 
will obviously depend on the learner's previous reinforcement history. 
Moreover, the learner's intelligence and his aptitudes and interests 
with respect to the subject matter being taught might influence the 
characteristics of the program having to do with repetition, sequence, 
and stepping. Although other workers have implied that the concept of 
individual differences is important to a discussion of the variables which 
affect program efficiency, only Glaser, Homme and Evans (13) have mentioned 
it explicitly. 
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One mifM hvcc^^-^iz^ ^^^^ effective instructional devices might wipe 
oxiz differences in ^^^^^^^^^ment measures as<=ociated with intelligence or 
aoti-.ude Le.-o cerfor^^nce, ^^.^ I'indinrs of a number of experiments seem 
to sunoort thi^ h>-r)0^>.esi ^ ^ *Port:er (26) found that the correlation between 
IQ and achieverr.ent '^^Uin^^ was not significantly different from zero 
for a grouo of lear^^^s t^^^^..^^ bv a self-instructional device, but among ^ 
the control si.jbnect;^ ^"^^Ght^ in the standard fashion, a significant positive 
relationship w^s fo"^^- tr^ on and ^rigc^ (16, p 8) reoorted that scatter 
nlots revealed litrA^ ^^l^tionshio between intelligence test scores (Otis) 
and retention, ^fter "^^^-^ninr by self-instructional devices. Ferster and 
9a-on (9) report^ed si r^ala^, "^^r^dings between altitude and achievement in a 
course in ^rernan- ^'^^^Uv L^jmsdaine (20) found that the advantage of 
active or oas^ve i:^^^^^^! t^ation in a simple learning task decreased with 
increases in intel l-^-^"^^ » 

One erolar^stLi or^ -vhiov^ mi.:ht be offered to acco'ont for the decrease in 
correlation betvr^^er) ^^^'^^Vement and intelligence or aptitude test per- 
formance is thMt t:^^ -^^^^nin^' of a sub,iect by teaching machine results in 
more homoge-eous acr^^^ven^ent'scores . Homme and Glaser (15); and Evans, 
Glaser and Homir.e (1^^ ^^^ort data in suDPort of this hypothesis, but 
Keislar (17) found ^nab machine instruction rendered the learners more 
variable on the ac Ini^'^^^-^nt measure than the control group. Clearly, 
more research of th^^ ^^^t is necessary before we can be sure of the 
effects of autoir.at<^^ ^"-^ruction uDon relations betv^een achievement and 
its classical predi*^^^^^ * 

Porter (26) ^x^y investigator who has reported on relations 

between a few non i^^^^^^ctual factors and achievement test scores earned 
by learners who ^^^^ "^^^ teachin^j machine. He found no relationship 
between the sex or ^^Udent, the liking for the instructional method, 
and achievement. Tl^-^^f^ ^j^^^ other non intellectual factors, such as level 
of anxiety of ^.he lf^^^'^e^ 

deserve careful attention- 
It should be r^o^ed t:}^^^ studies described in this section simply 
relate some charac; isti ^he learner to achievement resulting from 
automated ins tr u^t i^^^ » opposed to instruction byway of more standard 
teaching methods* '-^ile ^^^^ studies shed light on this important problem, 
they do not touoh "the p^g^ible interactions between characteristics of 
the learner and the variables which influence the effectiveness of 
automated instructi^^ ^oj, example, a study relating optimum size-of-step 
to the intellirrence ^f t>^^ ^^^j^^^r seems very much in order. Such a study 
and others like it ^^^Ici ^dd the concept of individual differences to the 
other classes of v^^^^^l^^ all of which must oe examined as a part of a 
functional analysis ^^^tomated instruction* 



smmRY 



This report ^°^^ht to review the current literature of self- 

instructional devices wi-^^ identifying and examining significant 
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conceots and issues. Three rr^.e jor parameters are thou^^-ht to determine the 
effect,] ,.^^P55 of sclf-instrucLicn. These are (a) Lhe ^character is tics of 
t:he aevice or sl-cnaiion, (b) -.he charBcteri sties of the uror^ram, and (c ) 
the chaj^octeri^: tics of the learner. 

Device characterirtics ere thou.-ht to be a function of disolay (input) 
characteristics, response (outnut) characteri st; ic ? , and means for enhancing 
desired ner f crmance . //ith respect to zhe latter factor a distinction is 
rr:a.ae Detv/een charBcueri rti cs of zhe confirming; mechanism and characteristics 
O'- ^^^e reinforcement mechanism. Mn.ior attention was devoted to an analysis 
oi z..e orcces^^ of or o/:rarrjr.inti . Sunury variables on which the effectiveness 
oi ^^^Crams may depend were sug-esoed and discussed. A dearth of relevant 
experimental st^ndies was notea. A nrcvis'ional model of the learnin,-: 
processes controlled by effec::ive orocrams was presented. Finally, 

tr.e etr'ect? of individual differences on se If-instructi on were con.-idered. 
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